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Abstract. We are interested in rinding an explicit bijection between two families of com- 
binatorial objects: Gog and Magog triangles. These two families are particular classes of 
Gelfand-Tsetlin triangles and are respectively in bijection with alternating sign matrices 
(ASM) and totally symmetric self complementary plane partitions (TSSCPP). For this pur- 
pose, we introduce left Gog and GOGAm trapezoids. We conjecture that these two families 
of trapezoids are equienumerated and we give an explicit bijection between the trapezoids 
with one or two diagonals. 



1. Introduction 

This paper is a sequel to [1], to which we refer for more on the background of the Gog- 
Magog problem (see also [2] and [3] for a thorough discussion). It is a well known open problem 
in bijective combinatorics to find a bijection between alternating sign matrices and totally 
symmetric self complementary plane partitions. One can reformulate the problem using so- 
called Gog and Magog triangles, which are particular species of Gelfand-Tsetlin triangles. In 
particular, Gog triangles are in simple bijection with alternating sign matrices of the same 
size, while Magog triangles are in bijection with totally symmetric self complementary plane 
partitions. In [5], Mills, Robbins and Rumsey introduced trapezoids in this problem by cutting 
out k diagonals on the right (with the conventions used in the present paper) of a triangle of 
size n, and conjectured that Gog and Magog trapezoids of the same size are equienumerated. 
Zeilberger [7] proved this conjecture, but no explicit bijection is known, except for k — 1 (which 
is a relatively easy problem) and for k = 2, this bijection being the main result of [1]. In this 
last paper a new class of triangles and trapezoids was introduced, called GOGAm triangles (or 
trapezoids), which are in bijection with the Magog triangles by the Schiitzenberger involution 
acting on Gelfand-Tsetlin triangles. 

In this paper we introduce a new class of trapezoids by cutting diagonals of Gog and GOGAm 
triangles on the left instead of the right. We conjecture that the left Gog and GOGAm trape- 
zoids of the same shape are equienumerated, and give a bijective proof of this for trapezoids 
composed of one or two diagonals. Furthermore we show that our bijection is compatible with 
the previous bijection between right trapezoids. It turns out that the bijection we obtain for left 
trapezoids is much simpler than the one of [1] for right trapezoids. Finally we can also consider 
rectangles (intersections of left and right trapezoids). For such rectangles we also conjecture 
that Gog and GOGAm are equienumerated. 

Our results are presented in this paper as follows. In section 2 we give some elementary 
definitions about Gelfand-Tsetlin triangles, Gog and GOGAm triangles, and then define left 
and right Gog and GOGAm trapezoids and describe their minimal completion. Section 3 is 
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devoted to the formulation of a conjecture on the existence of a bijcction between Gog and 
GOGAm trapezoids of the same size. We end this paper by section 4 where we give a bijection 
between (n, 2) left Gog and GOGAm trapezoids and we show how its work on an example. 
Finally, we consider another combinatorial object; rectangles. 

2. Basic definitions 

We start by giving definitions of our main objects of study. We refer to [1] for more details. 
2.1. Gelfand-Tsetlin triangles. 

Definition 2.1. A Gelfand-Tsetlin triangle of size n is a triangular array X — (Xjj)„^^j^i 
of positive integers 

X n> l X nt 2 ■ ■ ■ ■ ■ ■ A„ „_i X niTl 

X-n-1,1 X n _i t 2 •■• •' A„_ ln _ 1 



-^2,1 A 2> 2 

such that 

X i+1J < X id < X i+1J+1 for n - 1 ^ i ^ j > 1. (2.1) 

The set of all Gelfand-Tsetlin triangles of size n is a poset for the order such that X ^ Y if 
and only if Xy SC Yij for all i, j. It is also a lattice for this order, the infimum and supremum 
being taken entrywise: max(A, Y)ij = max(Xy, Yij). 

2.2. Gog triangles and trapezoids. 

Definition 2.2. A Gog triangle of size n is a Gelfand-Tsetlin triangle such that 

(1) its rows are strictly increasing; 

X id < X i)j+1 , j < i ^ n - 1 (2.2) 

(2) and such that 

X n ,j =3, l^j^n (2.3) 
Here is an example of Gog triangle of size n = 5 

1 2 3 4 5 

13 4 5 

1 4 5 (2.4) 

2 4 
3 

It is immediate to check that the set of Gog triangles of size n is a sublattice of the Gelfand- 
Tsetlin triangles. 

Definition 2.3. A (n, k) right Gog trapezoid (for k ^ n) is an array of positive integers X = 
formed from the k rightmost SW-NE diagonals of some Gog triangle of 

size n. 
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Below is a (5, 2) right Gog trapezoid. 

4 5 
4 5 

3 4 (2.5) 

1 3 
2 

Definition 2.4. A (n,k) left Gog trapezoid (for k ^ n) is an array of positive integers X = 
(Xij) n ^i^j^i:k^j formed from the k leftmost NW-SE diagonals of a Gog triangle of size n. 

A more direct way of checking that a left Gelfand-Tsetlin trapezoid is a left Gog trapezoid 
is to verify that its rows are strictly increasing and that its SW-NE diagonals are bounded 
by 1,2,..., n. 

Below is a (5, 2) left Gog trapezoid. 

1 2 
1 3 

2 3 (2.6) 

2 4 
4 

There is a simple involution I^Ion Gog triangles given by 

X id = n + 1 - (2.7) 

which exchanges left and right trapezoids of the same size. This involution corresponds to a 
vertical symmetry of associated ASMs. 

2.2.1. Minimal completion. Since the set of Gog triangles is a lattice, given a left (resp. a right) 
Gog trapezoid, there exists a smallest Gog triangle from which it can be extracted. We call 
this Gog triangle the canonical completion of the left (resp. the right) Gog trapezoid. Their 
explicit value is computed in the next Proposition. 

Proposition 2.5. 

(1) Let X be a (n, k) right Gog trapezoid, then its canonical completion satisfies 

Xij =j for i^j + k (2.8) 

(2) Let X be a (n, k) left Gog trapezoid, then its canonical completion satisfies 

X^ = max(A ijfc + j - k, A;_i, fe + j - k - 1, . . . , Xi_ j+kik ) for j ^ k (2.9) 



Proof. The first case (right trapezoids) is trivial, the formula for the second case (left trapezoids) 
is easily proved by induction on j — k. □ 
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For example, the completion of the (5,2) left Gog trapezoid in (2.6) 

1 2 3 4 5 

13 4 5 

2 3 4 (2.10) 

2 4 
4 

Remark that the supplementary entries of the canonical completion of a left Gog trapezoid 
depend only on its rightmost NW-SE diagonal. 

The right trapezoids defined above coincide (modulo easy reindexations) with those of Mills, 
Robbins, Rumsey [5], and Zeilberger [7]. They are in obvious bijection with the ones in [1] 
(actually the Gog trapezoids of [1] are the canonical completions of the right Gog trapezoids 
defined above). 



2.3. GOGAm triangles and trapezoids. 

Definition 2.6. A GOGAm triangle of size n is a Gelfand-Tsetlin triangle such that X nn ^ n 
and, for all 1 ^ k ^ n — 1, and all n = jo > ji > 32 ■ ■ ■ > jn-k ^ 1,. one has 

^ - Xj i+1+i j i+1 J + Xj n _ k+n -k,j n _ k ^ k (2-11) 

i=0 / 

It is shown in [1] that GOGAm triangles are exactly the Gelfand-Tsetlin triangles obtained 
by applying the Schiitzenberger involution to Magog triangles. It follows that the problem of 
finding an explicit bijection between Gog and Magog triangles can be reduced to that of finding 
an explicit bijection between Gog and GOGAm triangles. In the sequel, Magog triangles will 
not be considered anymore. 

Definition 2.7. A {n,k) right GOGAm trapezoid (for k ^.n) is an array of positive integers 
X = (xi,j)n^i^j^:i;i~j^k-i formed from the k rightmost SW-NE diagonals of a GOGAm triangle 
of size n. 

Below is a (5, 2) right GOGAm trapezoid 



2 4 
2 4 
2 4 
1 4 
3 



(2.12) 



Definition 2.8. A (n,k) left GOGAm trapezoid (for k ^ n) is an array of positive integers 
A = (xi,j)n^ii^j^i;k^j formed from the k leftmost NW-SE diagonals of a GOGAm trapezoid of 
size n. 

A (5, 2) left GOGAm trapezoid 
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1 1 

1 2 

1 2 (2.13) 

2 3 
3 

2.3.1. Minimal completion. The set of GOGAm triangles is not a sublattice of the Gelfand- 
Tsetlin triangles, nevertheless, given a right (resp. a left) GOGAm trapezoid, we shall see that 
there exists a smallest GOGAm triangle which extends it. We call this GOGAm triangle the 
canonical completion of the left (resp. the right) GOGAm trapezoid. 

Proposition 2.9. 

(1) Let X be a (n, k) right GOGAm trapezoid, then its canonical completion is given by 

Xij = 1 forn^i^j + k (2.14) 

(2) Let X be a (n, k) left GOGAm trapezoid, then its canonical completion is given by 

X^ = Xi_ j+kyk for ft ^ i^ j ^ k (2-15) 
in other words, the added entries are constant on SW-NE diagonals 

Proof. In both cases, the completion above is the smallest Gelfand-Tsetlin triangle containing 
the trapezoid, therefore it is enough to check that if X is a (n, k) right or left GOGAm trapezoid, 
then its completion, as indicated in the proposition 2.9, is a GOGAm triangle. The claim follows 
from the following lemma. 

Lemma 2.10. Let X be a GOGAm triangle. 

i) The triangle obtained from X by replacing the entries on the upper left triangle {Xij, n ^ 
i ^ j + k) by 1 is a GOGAm triangle. 

ii) Let n ^ m ^ k ^ 1. If X is constant on each partial SW-NE diagonal (Xi + i_k+r,n — 
i ^ I ^ 0) for i ^ m + 1 then the triangle obtained from X by replacing the en- 
tries {X m+ i^+f, n — m ^ I ^ 1) by X m ^ is a GOGAm triangle. 

Proof. It is easily seen that the above replacements give a Gelfand-Tsetlin triangle. Both 
proofs then follow by inspection of the formula (2.11), which shows that, upon making the 
above replacements, the quantity on the left cannot increase. □ 

End of proof of Proposition 2.9. The case of right GOGAm triangles is dealt with by part i) of 
the preceding Lemma. The case of left trapezoids follows by replacing successively the SW-NE 
partial diagonals as in part ii) of the Lemma. □ 

For example, the completion of the (5,2) left GOGAm trapezoid in (2.13) 

112 2 3 

12 2 3 

1 2 3 (2.16) 

2 3 
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3. Results and conjectures 

Theorem 3.1 (Zeilberger [7]). For all k ^ n, the (n,k) right Gog and GOGAm trapezoids are 
equienumerated 

Actually Zeilberger proves this theorem for Gog and Magog trapezoids, but composing by 
the Schutzenberger involution yields the above result. In [1] a bijective proof is given for (n, 1) 
and (n, 2) right trapezoids. 

Conjecture 3.2. For all k sj n, the (n, k) left Gog and GOGAm trapezoids are equienumerated. 

In the next section we will give a bijective proof of this conjecture for (n, 1) and (n, 2) 
trapezoids. 

Remark that the right and left Gog trapezoids of shape (n, k) are equienumerated (in fact a 
simple bijection between them was given above). 

If we consider left GOGAm trapezoids as GOGAm triangles, using the canonical completion, 
then we can take their image by the Schutzenberger involution and obtain a subset of the 
Magog triangles, for each (n,k). It seems however that this subset does not have a simple 
direct characterization. This shows that GOGAm triangles and trapezoids are a useful tool in 
the bijection problem between Gog and Magog triangles. 

4. BlJECTIONS BETWEEN GOG AND GOGAM LEFT TRAPEZOIDS 

4.1. (n, 1) left trapezoids. The sets of (n, 1) left Gog trapezoids and of (n, 1) left GOGAm 
trapezoids coincide with the set of sequences A„ i, . . . ,Xi,± satisfying Xj t i ^ n — j + 1 (note 
that these sets are counted by Catalan numbers). Therefore the identity map provides a trivial 
bijection between these two sets. 

4.2. (n, 2) left trapezoids. In order to treat the (n, 2) left trapezoids we will recall some 
definitions from [1]. 

4.2.1. Inversions. 

Definition 4.1. An inversion in a Gelfand-Tsetlin triangle is a pair such that Xij = 

Xi+ij. 

For example, the Gog triangle in (4.1) contains three inversions, (2,2), (3,1), (4,1), the 
respective equalities being in red on this picture. 

1 2 3 4 5 

L 3 4 5 

1 4 5 (4.1) 
2 4 
3 

Definition 4.2. Let X = (-2Q,j)n>-t>j>l be a Gog triangle and let be such that 1 ^ j ^ 

i ^ n. 

An inversion (k, I) covers (i,j) if i = k + p and j = I + p for some p with 1 ^ p ^ n — k. 
The entries (i,j) covered by an inversion are depicted with " + " on the following picture. 
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o o o + o 

\ 

o o + o 




(4.2) 



o 



4.2.2. Standard procedure. The basic idea for our bijection is that for any inversion in the Gog 
triangle we should subtract 1 to the entries covered by this inversion, scanning the inversions 
along the successive NW-SE diagonals, starting from the rightmost diagonal, and scanning 
each diagonals from NW to SE. We call this the standard procedure. This procedure does not 
always yield a Gelfand-Tsetlin triangle, but one can check that it does so if one starts from a 
Gog triangle corresponding to a permutation matrix in the correspondance between alternating 
sign matrices and Gog triangles. Actually the triangle obtained is also a GOGAm triangle. 
Although wc will not use it below, it is informative to make the following remark. 

Proposition 4.3. Let X be the canonical completion of a left (n, k) Gog trapezoid. The trian- 
gle Y obtained by applying the standard procedure to the n — k + 1 rightmost NW-SE diagonals 
of X is a Gelfand-Tsetlin triangle such that Yi+i.k+i = Xj & for n — 1. 

Proof. The Proposition is proved easily by induction on the number n — k + 1 . □ 
For example, applied to the (5,2) left Gog trapezoid in (2.6), this yields 



1 2 3 3 4 

13 3 4 

2 3 4 (4.3) 

2 4 
4 

Like in [1] the bijection between left Gog and GOGAm trapezoids will be obtained by a 
modification of the Standard Procedure. 

4.2.3. Characterization of (n, 2) GOGAm trapezoids. The family of inequalities (2.11) simplifies 
in the case of (n, 2) GOGAm trapezoids, indeed if we identify such a trapezoid with its canonical 
completion, then most of the terms in the left hand side are zero, so that these inequalities reduce 
to 

X h2 < n-i + 2 (4.4) 
X i>2 - Xi- 1A + X itl < n-i + l (4.5) 

Remark that, since — Xj—i.i+X^i ^ 0, the inequality (4.5) follows from (4.4) unless X-i,i = 

Xj,l. 
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4.2.4. From Gog to GOG Am. Let X be a (n, 2) left Gog trapezoid. We shall construct a (n, 2) 
left GOGAm trapezoid Y by scanning the inversions in the leftmost NW-SE diagonal of X, 
starting from NW. Let us denote by n > %\ > . . . > ik ^ 1 these inversions, so that Xj.i = Xj+i.i 
if and only if i S {ix, • ■ • , ik}- We also put i = n. We will construct a sequence of (n, 2) left 
Gelfand-Tsetlin trapezoids X = r<°>, Y^\ . . . , = Y. 

Let us assume that we have constructed the trapezoids up to yW, that yW ^ X, that = 
Xij for i ^ ii, and that inequalities (4.4) and (4.5) are satisfied by Y^ for i ^ ii + 1. This is 
the case for Z = 0. 

Let m be the largest integer such that Y^ 2 — Y^ i+12 . We put 

l = l f° r n ^ £ > m and ^ i 

Y$ +1) = , for m - 1 > i > 



(U 
'■>1 


-i) 


_ Y {i) 

— 


for 


(H 
'■>1 


-i) 


_ V W 
— 


for 


(M 
•:.2 


-i) 


_ v « 

~~ 4,2 


for 


(H 
•:,2 


-i) 


= ig-i 


for 



Y>Y ' = Y> 2 > for + 1 and > i 

r^ 2 +1) = 1$ - 1 for m ^ i ^ + 1. 

From the definition of m, and the fact that X is a Gog trapezoid, we see that this new 
triangle is a Gelfand-Tsetlin triangle, that ^ X, and that Y^ +1 ^ = Xij for i ^ Let 

us now check that the trapezoid satisfies the inequalities (4.4) and (4.5) for i ^ + 1. 

The first series of inequalities, for i ^ + 1, follow from the fact that Y^ ^ X. For the 
second series, they are satisfied for i > to + 1 since this is the case for y W . For to ^ i ^ + 1, 
observe that 

v (H+i) _ y-(i+i) < Y (l+i) _ Y (i+i) _ v (k) _ 1 ^ _ . 

J 4,2 '4+1,1 " r J: 4+l,l 2 4,2 — I m,2 ~ 1 m,2 1 " 

by (4.4) for y('), from which (4.5) follows. 

This proves that y( ;+1 ) again satisfies the induction hypothesis. Finally Y = Y^ is a 
GOGAm triangle: indeed inequalities (4.4) follow again from y(' +1 ) X, and (4.5) for i ^ i k 
follow from the fact that there are no inversions in this range. It follows that the above algorithm 
provides a map from (n, 2) left Gog trapezoids to (n, 2) left GOGAm trapezoids. Observe that 
the number of inversions in the leftmost diagonal of Y is the same as for X, but the positions 
of these inversions are not the same in general. 

4.2.5. Inverse map. We now describe the inverse map, from GOGAm left trapezoids to Gog 
left trapezoids. 

We start from an (n, 2) GOGAm left trapezoid Y, and construct a sequence 
y = y W , y , y ( fc - 2 ) , . . . , y(°) = X of intermediate Gelfand-Tsetlin trapezoids. 
Let n— 1 ^ ti > L2 ■ ■ ■ > tk 1 be the inversions of the leftmost diagonal of y, and let i^+i = 0. 
Assume that Y^ has been constructed and that Y^ — Yij for i — j iz+i. This is the case 
for / = fc. 

Let p be the smallest integer such that Y^_ x 2 = Y^g. We put 

Y^ l) = Y^ for n^i^ n + 1 and p ^ i 

y}[- 1} = y/i^ for t/^z^p 

y^"^ = y^ 2 } for n ^ i ^ h + 2 and p - 1 > i 

y/ 2 _1) = Xfl - 1 for t, + 1 > i > p. 



It is immediate to check that if X is an (n, 2) left Gog trapezoid, and Y is its image by the 
first algorithm then the above algorithm applied to Y yields X back, actually the sequence Y^ 1 ' 
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is the same. Therefore in order to prove the bijection we only need to show that if Y is a (n, 2) 
left GOGAm trapezoid then the algorithm is well defined and X is a Gog left trapezoid. This 
is a bit cumbersome, but not difficult, and very similar to the opposite case, so we leave this 
task to the reader. 



4.2.6. A statistic. Observe that in our bijection the value of the bottom entry Ai.i is unchanged 
when we go from Gog to GOGAm trapezoids. The same was true of the bijection in [1] for right 
trapezoids. Actually we make the following conjecture, which extends Conjecture 3.2 above. 



Conjecture 4.4. For each n,k,l the {n,k) left Gog and GOGAm trapezoids with bottom en- 
try X\.i — I are equienumerated. 



4.3. An example. In this section we work out an example of the algorithm from the Gog 
trapezoid X to the GOGAm trapezoid Y by showing the successive trapezoids Y^> . At each 
step we indicate the inversion in green, as well as the entry covered by this inversion in shaded 
green, and the values of the parameters ii,p. The algorithm also runs backwards to yield the 
GOGAm->Gog bijection. 



1 2 

\ 

1 

1 



x = 

i% = 6 
to = 7 



4 

3 4 
3 



1 1 
1 



\ 



f 



y(2) 

i 2 = 5 
to = 6 



3 4 
3 
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1 1 

1 1 
1 

2 



y(2) 
m = 5 



3 4 
\ 

3 4 



1 1 
1 1 
1 

1 



3 

2 3 



y(3) 

14 = 1 

m = 2 



3 4 
\ 

3 



1 1 
1 1 
1 3 

l 3 y( 4 ) = y 

2 3 
3 3 
3 

4.4. Rectangles. 

Definition 4.5. For (n, k, I) satisfying k + I ^ n + 1, a (n,k,l) Gog rectangle is an array of 
positive integers X = {xi.j) n ^i^j^i-.k^j:j+i^i+i formed from the intersection of the k leftmost 
NW-SE diagonals and the I rightmost SW-NE diagonals of a Gog triangle of size n. 

Definition 4.6. For (n, k, I) satisfying k + I ^ n + 1, a (n,k,l) GOG Am rectangle is an array 
of positive integers X = (xij) n ^ l i^j^i ] k^j:j+i^i+i formed from the intersection of the k leftmost 
NW-SE diagonals and the I rightmost SW-NE diagonals of a GOG Am triangle of size n. 

Similarly to the case of trapezoids, one can check that a (n, k, I) Gog (resp. GOGAm) 
rectangle has a canonical (i.e. minimal) completion as a (n, k) left trapezoid, or as a (n, /) right 
trapezoid, and finally as a triangle of size n. 

Conjecture 4.7. For any (n, k, I) satisfying k + I ^ n + 1 the (n, k, I) Gog and GOGAm 
rectangles are equienumerated. 

As in the case of trapezoids, there is also a refined version of the conjecture with the statis- 
tic An preserved. 
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One can check, using standard completions, that our bijections, in [1] and in the present 
paper, restrict to bijections for rectangles of size (n, fc,2) or (n,2,i). Furthermore, in the case 
of (n, 2, 2) rectangles, the bijections coming from left and right trapezoids are the same. 
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